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Abstract — The paper studies the problem of filtering a 
discrete-time linear system observed by a network of sensors. 
The sensors share a common communication medium to the 
estimator and transmission is bit and power budgeted. Under 
the assumption of conditional Gaussianity of the signal process 
at the estimator (which may be ensured by observation packet 
acknowledgements), the conditional prediction error covariance 
of the optimum mean-squared error filter is shown to evolve 
according to a random dynamical system (RDS) on the space 
of non-negative definite matrices. Our RDS formalism does not 
depend on the particular medium access protocol (randomized) 
and, under a minimal distributed observability assumption, 
we show that the sequence of random conditional prediction 
error covariance matrices converges in distribution to a unique 
invariant distribution (independent of the initial filter state), 
i.e., the conditional error process is shown to be ergodic. Under 
broad assumptions on the medium access protocol, we show that 
the conditional error covariance sequence satisfies a Markov- 
Feller property, leading to an explicit characterization of the 
support of its invariant measure. The methodology adopted 
in this work is sufficiently general to envision this application 
to sample path analysis of more general hybrid or switched 
systems, where existing analysis is mostly moment-based. 

Index Terms — Networked Control Systems, Sensor Networks, 
Random Dynamical Systems, Estimation Error, Weak Conver- 
gence, Sensor Schedule. 

I. Introduction 
A. Background and Motivation 

Networked Control Systems (NCS) have been proposed 
as the paradigm to model, design and analyze control sys- 
tems where the effects of computation and communication 
on the performance of the closed loop system cannot be 
neglected and need to be incorporated in the model. NCS are 
amenable to describe large-scale systems where components 
may be spatially distributed and demand the services of a 
communication network to exchange information. Integration 
of communication models traditionally renders the problem 
of design and analysis very complex, as the traditional 
mathematical machinery employed in control systems in 
general is not adequate to include in its framework stochastic 
models of communication. 

A new approach capable of capturing the complexity of 
NCS by being able to extract fundamental limitations and 
relevant properties is needed. In [1] we proposed to use the 
Random Dynamical Systems [2] framework to characterize 
the problem of Kalman filtering where observations may be 
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dropped in the communication between the sensors and the 
estimator, as in the case where a wireless sensor network is 
employed to observe the evolution of a particular dynamical 
system. The problem was originally analyzed in [3]. In that 
work the authors proved the existence of a critical packet 
arrival rate, below which the estimation error covariance, 
a stochastic variable dependent upon the realization of the 
packet arrival process, would have infinite mean, rendering 
the estimate useless. 

In this case the optimal estimator would fail to track the 
system. The model proposed in [3] has been widely adopted 
and extended by several authors [4], [5], [6], [7], [8], [9], 
[10]. Although many present extensions to general Markov 
chains and account for smart sensors sending local estimates 
instead of observations, all the results are established with 
respect to mean stability i.e., boundedness of the mean co- 
variance. This metric is unsatisfactory in many applications, 
as it does not provide information about the fluctuations of 
the error covariance that could grow and be unusable for long 
time intervals. We would like to characterize the asymptotic 
behavior of its distribution-the goal of this paper. In [1], the 
authors showed how RDS can be used to fully characterize 
the problem, by providing conditions on the convergence in 
distribution of the error covariance to a stationary distribution 
whose support can also be explicitly characterized. 

In this paper we extend the result of [1] to the case of 
many sensors. In particular it is not our goal to evaluate 
the performance of the filter with respect to a specific sensor 
scheduling policy or communication protocol, but to uncover 
the macroscopic properties of such policies and their effect 
on the performance of the overall systems. Under fairly 
general assumptions on the sensor schedule (which may be 
a system design objective or imposed by the random com- 
munication medium) and a minimal detectability condition, 
we show ergodicity of the conditional error covariance se- 
quence and explicitly characterize the support of the resulting 
invariant distribution. For clarity we focus on temporally 
i.i.d. schedules in this paper, but note how the approach can 
be extended to cover more general Markovian scheduling 
policies. We believe that this paradigm can be extended to 
the verification of properties of stochastic switched or hybrid 
systems where nowadays the analysis tends to be moment 
based. 

We briefly describe the organization of the rest of the 
paper. The problem is rigorously formulated in Section II 
and a description of the main results of the paper appear in 
Section III. Section IV presents the RDS formulation of the 
error covariance evolution. Several properties of the resulting 



RDS are presented in Section V, whereas, Section VI pro- 
vides outlines for the proofs. Finally, Section VII concludes 
the paper. 

B. Notation 

Denote by: K, the reals; K M , the M-dimensional Eu- 
clidean space; T, the integers; T + , the non-negative inte- 
gers; N, the natural numbers; and X, a generic space. The 
separable Banach space of symmetric M x M matrices is 
denoted by § M , equipped with the induced 2-norm. The 
subset §^ of positive semidefinite matrices is a closed, 
convex, solid, normal, minihedral cone in § n , with non- 
empty interior the set of positive definite matrices. 
The cone induces a partial order in § M , namely, for 
X,Y G S M , we write X < Y, if Y - X G Sf . In case 
X r< Y and X ± Y, we write X ~< Y. We also have a 
strong order by virtue of the non-emptiness of the interior 
of S^f, the set of positive definite matrices where we 
write X < Y, if Y - X G Sf + . 

II. Problem Formulation 

A. System Model 

We consider a discrete-time linear dynamical system being 
observed by a network of TV sensors. The signal model is 
given by: 

x(t + l) =Ax(t)+w(t) (1) 

where x(i) E K M is the signal (state) vector with initial 
state x(0) being distributed as a zero mean Gaussian vector 
with covariance P and the system noise {w(t)} is an 
uncorrected zero mean Gaussian sequence independent of 
x(0) with covariance Q. The observation at the n-th sensor 
y„(i) G R m " at time t is of the form: 

yn(t) = C n x(t)+v„(t) (2) 

where C„ £ j^nxM an( j | v „(t)} is an uncorrected zero 
mean Gaussian observation noise sequence with covariance 
P n 3> 0. Also, the noise sequences at different sensors are 
independent of each other, the system noise process and 
the initial system state. Because of limited capability of the 
sensors, typically the dimension of y n (£) is much smaller 
than that of the signal process and the observation process 
at each sensor is not sufficient to make the pair {x(f), y n (t)} 
observable. Thus the sensors need to collaborate and to 
achieve this, they share a common wireless medium to an 
estimator (possibly remote.) Such a medium is bit and power 
constrained, the channel access is opportunistic and hence at 
every iteration 1 only a subset of the N sensors are able to 
send their observations to the estimator. We assume there 
exists a randomized sensor schedule, where at each time t 
only a subset of sensors, randomly chosen, get channel access 
and successfully send their observations to the estimator. We 
formalize this as follows: 

Definition 1 (Sensor Schedule) : Let <p be the power set 
of {1, 2, • • • , n, ■ ■ ■ , N}, i.e., the set of 2 N of its subsets, 

'iteration refers to the discrete time index T+. 



including the null set. We number the elements of *p as i, 
where i ranges from to 2 N — 1 and w.l.o.g. assume that 
corresponds to the null set. A sensor schedule (randomized) 
V is a probability distribution on the set ^3, such that, at time 
t, the set T(t) of transmitting sensors is chosen randomly 
according to the distribution V from <p. Also, we assume that 
the random process {T(t)} t >o is an i.i.d. sequence (taking 
values in the set *}3 of subsets of {1, • • • , N }), 2 i.e., the 
set of transmitting sensors at time t is independent of the 
assignment at all previous times, leading to a memoryless 
channel. 

To every schedule V we assign a probability vector X v = 
[Aq\ • • • , \f N _ 1 ] T G [0, l] 2 ", such that, Zto 1 A P = 1 and 

P [l(t) = i | I(s), Q<s<t} = \?, Vi G T+ (3) 

The schedule defined above leads to temporally independent 
sensor assignments, but allows correlated transmissions at 
each time t among the sensors. The model is thus fairly 
general, capturing the class of memoryless (temporally) 
transmission schemes and subsumes many existing schedul- 
ing policies in networked control systems, for example, [3]. 
The model is not applicable to channels with memory, 
however, with the framework developed in this paper we can 
cope with a large class of Markovian channels as explained 
later. For clarity of presentation, we assume the memoryless 
scheduling policy T> defined above. 

Suppose a particular T> is in place. To a generic ele- 
ment i of we assign the corresponding subset is C 
{1,2,- •• ,N} indicating the sensors contained in i. We 
denote is by is — {ii,--- >i|» s |}> where \is\ denotes the 
cardinality of is and ij for j = 1, • • • , \is\ denotes the j-th 
sensor in the set is. With this notation in place, for every 
i G CP, we define 

& = [(%,(%,. :,C% igi ] T (4) 

v i (t) = [vl(t),---,vl sl (t)] T , VteT + (5) 

and let R l denote the covariance of the zero mean Gaussian 
vector v l (i), which we assume to be positive definite. Then, 
at time t, if some non-trivial subset of sensors reports to 
the estimator, i.e., if T(t) ^ (f>, the cumulative observation 
y x (') (t) arriving at the estimator is given by 

y IW (i) =C I Wx(i)+v I W(t) (6) 

We assume that, alongside the observation, every sensor 
sends an acknowledgement to the estimator whenever it gets 
to transmit. Thus the information available to the estimator 
at time t is given by 

m = {y I{s) (s),I(s), 0<s<t} (7) 

and the objective is to find the minimum mean squared 
estimator (mmse), which is the conditional mean 

x(i|t) = E [x(t) | 3f(t)] (8) 

2 Since we identify every element of *p with an unique integer i S 
{0, ■ • • ,2^ — 1}, for all purposes, we take l(t) to assume values in 
{(j,--. ,2^-1}. 



Conditioned on the information sequence {3(t)}, the signal 
process becomes conditionally Gaussian, and the conditional 
mean can be recursively updated by a modified (time- 
varying) Kalman filter ([11].) It is sufficient to study the 
evolution of the one-step predictor 

x(i|i- 1) =E[x(i) | 3(t-l)} (9) 

and the conditional prediction error covariance 

P(t) = E[(x(t) - x(t|t - 1)) (x(t) - x(t|t - 1)) T | I(t - 1)] 

(10) 

It can be shown that the random sequence {P(t)} t £T + 
evolves according to a random algebraic Riccati equation 
(RARE) as: 



P(t+1) = ^ 



AP(t)A T + Q 



if T(t) = 



AP(t)A T + Q- AP(t)(C x ^) T (c T ^P(C T ^) T 

+R X ^Y 1 C I(t) P(t)A T otherwise 

(11) 

with initial condition P(0) = Pq. Under the assumption of 
memoryless scheduling, the sequence {P(t)} is a Markov 
process whose asymptotic properties are of interest to us. To 
this end we define the continuous functions /; : §* f i — ► §>* f 
for i = 0, • • • , 2 N - 1 by 

MX) =AXA T + Q (12) 

fi(X) = AXA T + Q — AX(C i ) T (c l X(C l ) T + R l ) ~' C* ! XA T 

(13) 

for i = 1, ■ ■ ■ ,2 N — 1. With the above notation, the evolution 
of the RARE sequence {P(f)} can be described by: 



P(t + l) = f m (P(t)), P(0) = P 



(14) 



Since the sequence {fx(t)} comprises of i.i.d. random maps, 
the process {P(t)} is Markov. The RARE described above 
can be viewed as a generalization of the RARE studied in [1], 
where the sequence of prediction error covariance matrices 
involved switching between two random functions, one of 
which was the Lyapunov update like f and the other was 
the Riccati update like the = 1, - • • ,2 N — 1 considered 
in eqn. (13). Hence, as will be noted later, several technical 
results in this paper are direct generalizations of their specific 
cases considered in [1]. 

As is the case with even deterministic single sensor 
systems, some form of stabilizability and detectability is 
needed to guarantee stability of the filtering error process. 
We consider the following notion of weak detectability in a 
networked system: 

Definition 2 (Weak Detectability) : A sensor schedule V is 
called weakly detectable if there exists i ^ in *p with 
Xf > 0, such that the pair (C\A) is detectable. 

It is to be noted that the term 'weak' in the above definition 
not only indicates that the above is a weak condition on the 
sensor network, but also has implications to weak conver- 
gence (convergence in distribution) of the sequence {P(t)} 
as will be justified later. Note that weak detectability defined 
above does not require the pair (C n ,A) to be detectable 
for any sensor n, which may be too strong a condition, 



especially when the signal process is of large dimension and 
the individual sensors have limited observation capabilities. 
However, if the network is large, it is fair to assume that a 
subset of sensors exists, whose cumulative observations lead 
to a detectable system, and with some arbitrarily small but 
positive probability all sensors in this subset can transmit 
simultaneously. So far the concept of weak detectability, as 
stated above, has been an abstract notion and we are yet 
to show its effect on the long term behavior of the RARE 
sequence. 

We also make the following assumption on the signal 
process: 

Assumption E.l: The pair (A, Q 1 ! 2 ) is stabilizable, A is 
unstable and Q » 0. 

B. Stability notions and scheduling protocols 

In the sequel, when considering the sequence {P(t)}, we 
denote the probability and expectation operators by Y v - Pa [■] 
and E D - Pa [•] respectively to emphasize the dependence on 
the scheduling policy and the initial condition. Also, the 
corresponding sequence of measures induced by the RARE 
process on is denoted by {fi D ' Pa } te j + . 

We study the following notions of stability of the RARE 
sequence: 

Definition 3 (Stochastic boundedness) : A scheduling policy 
T> is said to achieve stochastic boundedness for the RARE 
sequence, if for all initial conditions P € , the sequence 
{P(t)} stays stochastically bounded, i.e., for all P e §^ 



lim sup r v ' Po < 



\Pt\\ >K)=Q 



(15) 



Definition 4 (Moment stability) A scheduling policy V is 
said to stabilize the RARE sequence in the k-th moment 
(1 < k < oo) if, for all initial conditions P e S^, the 
sequence {P(t)} has bounded moments of order k, i.e., for 
all P G §f 



sup E v ' p ° 
teT + 



< oo 



(16) 



We often abuse terminology to call a scheduling policy 
stochastically bounded (s.b.) or fc-th moment stable. 

The following proposition relates the two stability notions 
and establishes the important connection between weak de- 
tectability and stability: 

Proposition 5 Let the pair (A, Q 1 ^ 2 ) be stabilizable and A 
unstable. We then have the following: 

i Moment stability of any order implies stochastic bound- 
edness, i.e., if a scheduling policy V is moment stable 
of order k for some 1 < k < oo, then it is stochastically 
bounded. 

ii Weak detectability implies stochastic boundedness, i.e., 
a weakly detectable scheduling policy V is s.b. 

Proof: The first part is a general property of stochastic 
sequences and the proof uses Chebyshev type of inequalities 



to relate probability to expectation whose details can be 
found in [1]. The proof of the second part is more involved 
and lengthy, but an immediate generalization of its specific 
case involving a single sensor with intermittent transmissions 
is studied in [1],[12] and is omitted. ■ 

Remark 6 Proposition 5 shows that stochastic boundedness 
is weaker than moment stability and whereas weak de- 
tectability is sufficient to ensure s.b., stronger detectability 
assumptions are required to conclude moment stability. This 
is illustrated by an example of a single sensor system 
as described below. Our interest in stochastic boundedness 
comes from the fact that it is sufficient to ensure ergodicity 
of the process {P(t)}, the key point of the paper. The rest of 
the paper concerns this important relation between stochastic 
boundedness (and hence weak detectability by Proposition 5) 
and ergodicity of the RARE sequence, and this is achieved 
by using tools from the theory of RDS. 

Example: Single sensor system with intermittent trans- 
mission 

For a single sensor system, a scheduling policy corresponds 
to assigning a probability 7 G [0,1] of packet transmission. 
This is studied in detail in [ 1 ],[ 12] . We assume that 7 > 
and the pair (A, C\) is observable, which corresponds to the 
notion of weak detectability in the general case. In [1],[12] 
it was shown that 7 > is a necessary and sufficient 
condition for stochastic boundedness if A is unstable (the 
case of invertible C was shown in [1], whereas [12] proves 
the general observable case), whereas mean stability of the 
sequence {P(t}} requires 7 to be greater than a critical value 
which increases to 1 as A becomes more and more unstable 
(see [3] for a lower bound on this critical probability.) 
Moreover, in [1] it was shown that stochastic boundedness 
(7 > 0) is sufficient to ensure ergodicity of the RARE 
process and hence we can establish that the sequence {P(t)} 
converges to a unique invariant distribution even if it is not 
stable in the mean. In this paper, we take this further and 
show that a weakly detectable schedule is sufficient to ensure 
ergodicity of {P(t)}, even if it is not moment stable of any 
order k. 

III. Main Results: Invariant Distribution 

We state the main results of the paper. Proof outlines are 
provided in Section VI, the details will appear elsewhere. 
Several key technical components of the proofs are direct 
generalizations of the development in [1] for the single 
sensor case. 

The first result concerns the ergodicity of the conditional 
error covariance process. 

Theorem 7 Let Assumption E.l hold and the scheduling 
policy V be weakly detectable. Then there exists a unique 
invariant distribution \P supported on the set of positive 
definite matrices s.t. the RARE sequence {Pt} te j + (or 

the sequence \ n t ' \ of measures) converges weakly 

I J teT + 

to /jP from any initial condition P . 



The second result explicitly determines the support of the 
invariant measure \P '. 

Theorem 8 Let the hypotheses of Theorem 7 hold. Define 

the set J(D) C <P as: 

J(V) = {i e <P I Af > and the pair (C\A) is detectable} 

(17) 

For every i G J(T>) define the set 3 

S i = {fi 1 of l2 o...of ls (P*) I i r e {(),•■■, 2" -1}, 

Kr<s,s6 T+} (18) 

where P* is the unique fixed point of the operator : 
§f 1 — > §f . 4 We then have: 

i Si = Sj for all i,j e J(V). 

ii The invariant measure pP is supported on the closure 
of Si, where i G J(T> ), i.e., 

supp(/x P ) =d(5i), i G J(V) (19) 

where cl denotes the topological closure of a set on the 
space Sf . 

Discussions: Theorem 7 establishes the ergodicity of the 
prediction error covariance sequence {P(t)} under the as- 
sumption that the scheduling policy T> is weakly detectable. 
The support of the invariant distribution fi v is explicitly 
characterized in Theorem 8 in terms of the network param- 
eters. Note that, in particular, if T>\ and T>2 are two weakly 
detectable scheduling policies, such that there exists i G *P 
with \f\\f 2 > and {C\A) is detectable, then 

supp (fi Vl ) = supp (fi V2 ) = cl (Si) (20) 

where Si is defined in eqn. (18). As shown in the single 
sensor case ([1]), the invariant distributions \P are generally 
not absolutely continuous w.r.t. the Lebesgue measure and 
the supports supp [yP) are highly fractured subsets of 

As is noted in the proof of Theorem 7 (Subsection VI- A), 
the only requirement is stochastic boundedness of the se- 
quence {P(t)} from every initial condition. Weak detectabil- 
ity ensures this condition (Proposition 5) and is generally 
stronger than the requirement on stochastic boundedness. 
Thus, the conclusions of Theorem 7 may stay valid under 
even weaker conditions on the schedule T>, provided we 
are able to establish stochastic boundedness of {P(t)} from 
every initial condition. However, in the absence of weak 
detectability, an explicit characterization of the invariant 
distribution, as in Theorem 8 may not be possible. 

Similarly, we can extend Theorem 7 to stationary tempo- 
rally Markovian schedules (i.e., the selection process {T(t)} 
is a stationary Markov process rather than i.i.d.). The proof 
and conclusions of Theorem 7 will be unchanged, as the RDS 
formulation of the error process requires only stationarity 
(see [13].) However, with a non i.i.d. selection process 

3 Below, in definition of Si, s can take the value 0, implying P* £ S. 
4 The stabilizability of (A, Q 1 / 2 ) and the detectability of (C\A) guar- 
antee the existence of such a P* . 



{l(t)}, the sequence {P(t)} no longer stays Markov and 
hence the assertions of Theorem 8 may not be valid. 

IV. Random Dynamical System Formulation 

In this section, we formulate the RARE process as an RDS 
evolving on S+. An excellent treatment of the theory of RDS 
can be found in [14], [13] and the concepts relevant to us 
are detailed in [1]. To minimize overlap with [1] and due to 
lack of space, we mention RDS facts, as and when required. 

We start by defining a random dynamical system (RDS). 
We follow the notation in [14], [13]. 

Definition 9 (RDS) A RDS with (one-sided) time T + and 
state space X is the pair (9, ip): 

A) A metric dynamical system 9 = (fi, J 7 , P, {0 t ,t £ T}) 
with two-sided time T, i.e., a probability space 
(fl,J-,F) with a family of transformations {9 t : fi i — ► 
fi} t6 T such that 

A.1) 9 = ida, t o9 s = 9 t+s , Vt, s £ T 
A.2) (t, ijj) i — ► 6 t uj is measurable. 

A. 3) 6 t F = P Vt £ T, i.e., P (9 t B) = P(B) for all 
B £ T and all t £ T. 

B) A cocycle lp over 9 of continuous mappings of X with 
time T + , i.e., a measurable mapping 

(p : T+ x x X -> X, (t,w,X) i — > <p(t,u,X) (21) 

B. l) The mapping X i — ► tp(t,u),X) = <p(t,u)X is 
continuous in X Vt £ T + , u> £ O. 

B.2) The mappings <fi(t,u) = ip(t,u,-) satisfy the 
cocycle property: Vt,seT + , lo £ fi, 



V?(0, w) = id*, (^(i + s,w) 



ip(t,6 a w) o i/?(s,w) 
(22) 



In a RDS, randomness is captured by the space (CI, J 7 , P). 
Iterates indexed by cj indicate pathwise construction. For 
example, if X is the deterministic state at t = 0, the state 

at t e T+ is 

X t (w) = ¥ >(t,w,X ) (23) 

The measurability assumptions guarantee that the state X t 
is a well-defined random variable. Also, the iterates are de- 
fined for non-negative (one-sided) time; however, the family 
of transformations {9 t } is two-sided, which is purely for 
technical convenience, as will be seen later. 

We now show that the sequence {Pt} generated by the 
RARE can be modeled as the sequence of iterates (in the 
sense of distributional equivalence) of a suitably defined 
RDS. 

Fix a schedule T> and define: I ft, J 7 , P 15 ) , where = *p, 



T is the power set of ^ and the discrete probability measure 
pv is defined by 



(24) 



product measure 5 . From the construction, a sample point 
ijj e Q, is a two-sided sequence taking values in the discrete 
set <p = {0, • • • , 2 N - 1} and, since V v is the product of 
P 15 , the projections are i.i.d. random variables with common 
distribution V. Define the family of transformations {#^} tgT 
on as the family of left-shifts 

9fuj = Lu(t + •), Vt e T (25) 

With this, the space (ft, J 7 , P T , {0f , t £ T}) is the canonical 
path space of a two-sided stationary (in fact, i.i.d.) sequence 
equipped with the left-shift operator; hence, (e.g., [15]) it 
satisfies the Assumptions A.l)-A.3) to be a metric dynamical 
system; in fact, it is ergodic. 

Recall the functions fi(X) in eqns. (12,13). Define the 
function / : O x i — ► §f by 

f(u,X) = f u(0) (X) (26) 

Since the projection map from ui to w(0) is measurable 
(continuous) and fi(X) is jointly measurable in i,X, it 
follows that /(■) is jointly measurable in uj,X. Define the 
function ^:T + x!lxS + — > §+ by 

ifi R (0,Lu,X) = X (27) 
<fi R (l,u,,X) = f{to,X) (28) 
<p R (t,u>,X) = f(e R _iOJ, V R {n-l,uj,X)) (29) 

It follows from the measurability of the transformations 
{0 R \, the measurability of /(•), and the fact that T + is 
countable that the function (p R (t, lo, X) is jointly measurable 
in t,u),X. Finally, (p R (-) defined above satisfies Assump- 
tion B.l) by the continuity of the /jS, and Assumption B.2) 
follows by the construction given by eqns. (27-29). Thus, 
the pair (0 R , ip R ) is an RDS over S+\ Given a deterministic 
initial condition Pq £ it follows that the sequence 

{Pt} t £T generated by the RARE eqn. (11) is equivalent in 
the sense of distribution to the sequence {<fi R (t, lo, -Po)} teT+ 
generated by the iterates of the above constructed RDS, i.e., 



P t = ip H {t,uj,Po), VteT+ 



(30) 



Also, define the product space, (ft, J 7 , P^ 1 ), where Q = 
x iS T^ and T and ¥ v are the product cr-algebra and the 



Thus, investigating the distributional properties of {-P*} tGT+ 
is equivalent to analyzing the distributional properties of 
{tp R (t,u),P )} teJ+ , which we carry out in the rest of the 
paper. 

In the sequel, we use the pair (6, f) to denote a generic 
RDS and (9 R , f R ) for the one constructed above for the 
RARE. 

V. Properties of (9 r , tp R ) 

A. Facts about generic RDS 

We review concepts on RDS (see [14], [13] for details.) 
Consider a generic RDS (9, tp) with state space X as in 
Definition 9. Let X = V+, where V+ is a closed, convex, 
solid, normal, minihedral cone of a real Banach space V. 
Denote by ^ the partial order induced by V + in X and 

5 Note the difference between the measure P T> and the measures P x> ' P o 
defined in Subsection II-A. 



<< denotes the corresponding strong order. For clarity the 
reader may assume in the following that V = S M , X = 
V+ = S* f and represent the order induced by positive 

definiteness in the space S^. In fact, the RDS (8 R ,ip R ) 
considered in this paper evolves in the cone §^ of positive 
semidefinite matrices, where the partial order is induced by 
positive definiteness. 

Definition 10 (Order-Preserving RDS) : A RDS (6,ip) with 
state space V + is order-preserving if Vt G T + , uj G 

n, X, Y e V+, 

X <Y => tp(t,w,X) <p(t,uj,Y) (31) 

Definition 11 (Sublinearity) An order-preserving RDS 
(8, ip) with state space V+ is sublinear if for every X G V + 
and A e (0,1) we have 

X<p(t, uj, X) < <p(t, uj, XX), Vt > 0, uj G (32) 

The RDS is strongly sublinear if in addition to eqn. (32), we 
have 

X<p(t,u),X) < ip(t,u, XX), Vt > 0, uj G CI, X G intV + 

(33) 

Definition 12 (Equilibrium) A random variable u : ft i — > 
V+ is called an equilibrium (fixed point, stationary solution) 
of the RDS (8, ip) if it is invariant under ip, i.e., 

ip (t, uj, u(uj)) = u (8 t uj) , Vt G T+, uj G n (34) 

If eqn. (34) holds VuEfi, except on set of P measure zero, 
u is an almost equilibrium. 

Since the transformations {8 t } are measure-preserving, i.e., 
t P = P, Vt, we have 

u (8 t uj) = u(lo), Vt (35) 

By eqn. (34), for an almost equilibrium u, the iterates in the 
sequence {(p (t, oj, u(oj))} teT+ have the same distribution, 
which is the distribution of u. 

Definition 13 (Orbit) For a random variable u : ft i — ► V+, 
we define the forward orbit r][(oj) emanating from u(uj) as 
the random set {tp (t, u>, u (w))} teT+ . The forward orbit gives 
the sequence of iterates of the RDS starting at u. 

Although rjl is the object of interest, for technical con- 
venience (as will be seen later), we also define the pull- 
back orbit r]^(uj) emanating from u as the random set 
{ip(t, 8- t oj,u{8- t Lu))} teT+ . 

We establish asymptotic properties for the pull-back orbit 
rf^. This is because it is more convenient and because 
analyzing rf^ leads to understanding the asymptotic distri- 
butional properties for r\' u . In fact, the random sequences 
{<p(t,w,u(w))} teT+ and {ip (t, 6L t w, u (0_ t w))} t£T+ are 
equivalent in distribution. In other words, 

tp (t, uj, u(uj)) = ip (t, 6- t co, u (8- t uj)) , Vt G T+ (36) 



This follows from 8 t P = P, Vt G T. Thus, in particular, we 
have the following assertion. 

Lemma 14 Let the sequence {tp (t, 6-tOJ, u (6>_ t w))} teT+ 
converge in distribution to a measure fj, on V+, where 
u : ft i — > V + is a random variable. Then the sequence 
{ip (f, u),u(uj))} teT+ also converges in distribution to the 
measure /i. 

We now introduce some notions of boundedness of RDS, 
which will be used in the sequel. 

Definition 15 (Boundedness) Let a : ft i — ► V + be a random 
variable. The pull-back orbit r) b a (uj) emanating from a is 
bounded on U G T if there exists a random variable C 
on U s.t. 

||^ (t, 6-tOJ, a {8- t oj))\\ < C(oj), Vt G T+, uj e U (37) 

Definition 16 ( Conditionally Compact RDS) An RDS (8, ip) 
in V+ is conditionally compact if for any U G T and pull- 
back orbit ri b a (uj) that is bounded on U there exists a family 
of compact sets {K (uj)}^^ s.t. 

lim dist (ip (t, 6- t oj, a (6L t w)) , K(uj)) = 0, w G U (38) 

t — >oo 

It is to be noted that conditionally compact is a topological 
property of the space V+. In particular, an RDS in a finite 
dimensional space V+ is conditionally compact. 

We now state a limit set dichotomy result for a class of 
sublinear, order-preserving RDS. 

Theorem 17 (Corollary 4.3.1. in [13]) Let V be a separable 
Banach space with a normal solid cone V+. Assume that 
(8, ip) is a strongly sublinear conditionally compact order- 
preserving RDS over an ergodic metric dynamical system 8. 
Suppose that tp(t, uj, 0) 3> for all t > and uj G £1. Then 
precisely one of the following applies: 

(a) For any X G V+ we have 

Pflim \\tp(t,8- t oj,X)\\ =oo) = 1 (39) 

(b) There exists a unique almost equilibrium u(uj) 3> 
defined on a 0-invariant set 6 W G T with P(fi*) = 
1 such that, for any random variable v(uj) possessing 
the property < v(uj) -< au(uo) for all uj G ft* and 
deterministic a > 0, the following holds: 

lim ip (t, 8-tto, v (8-tUj)) = u(uj), uj G O* (40) 

t — >oo 

In this subsection, we establish some properties of the 
RDS (8 R , tp R ) modeling the RARE. 

Lemma 18 The RDS (8 R , ip R ) with state space §^ is order- 
preserving. In other words, Vt G T+, uj G O, X, Y G §+ J , 

X <Y => uj R (t,uj,X)<ip R (t,uj,Y) (41) 

Also, if Q is positive definite, i.e., Q ^> 0, it is strongly 
sublinear. 

6 A set A e T is called 9-invariant if 0tA = A for all t 6 T. 



Proof: The proof uses properties of the functions 
fa (Lyapunov) and /jS (Riccati) and is routine given the 
arguments in [1] for the single sensor case. We omit it. ■ 

VI. Theorems 7,8: Proof Outlines 

We outline the proofs of Theorems 7,8. The proof of 
Theorem 7 relies on the RDS formulation of the RARE, and 
we highlight the significant steps in Subsection VI-A, the 
left-out details being a generalization of the single-sensor 
case in [1] are omitted. 

The proof of Theorem 8 rests on establishing the RARE 
sequence as a Markov Feller process and expressing the 
support of the invariant distribution as the intersection of 
the topological lower limits of all possible orbits. Due to 
space constraints, we do not provide details in this paper and 
rather explain intuitively how it parallels the corresponding 
development in [1]. 

A. Proof of Theorem 7 

Lemma 19 Consider the RDS (6 R ,tp R ). Let Assump- 
tion E.l hold and the scheduling policy V is such that the 
RARE sequence {P(t)} remains stochastically bounded for 
every initial condition P £ (by Lemma 5 this condition 
is satisfied, in particular, when V is weakly detectable.) 
Then, there exists a unique almost equilibrium vP(uj) 3> 
defined on a ^-invariant set Cl* £ T with ¥ v (CI*) = 1 
s.t. for any random variable v(u) possessing the property 
^ v(uj) < au v (u>)yuj £ Cl* and deterministic a > 0, the 
following holds: 

Urn ip R (t, R t u, v (e R t uj)) = iP(u), LueCl* (42) 

Proof: From Lemma 18, (8 R , ip R ) is strongly sublinear 
and order-preserving. It is conditionally compact because the 
space §^ is finite dimensional. Also, the cone §^ satisfies 
the conditions required in the hypothesis of Theorem 17. 
From the properties of the functions /j, we note for t > 

<p R (t, u, 0) - / w(t _ 1} (<p R (t - 1, w, 0)) h Q » (43) 

Thus the hypotheses of Theorem 17 are satisfied and pre- 
cisely one of the assertions a) or b) holds. We show asser- 
tion a) does not hold. Assume that a) holds on the contrary. 
Then, there exists P £ §^ such that 

F v ( lim \\ip R (t, 9 R t u, P a ) II = oo] = 1 (44) 

Then, for every K e T + , we have 

\im \\(p R (t,6 R t uj,P Q )\\ > K, P~a.s. (45) 

It can be shown then (see [1] for details) 

lim P~ (\\ip R (t, 6 R t u, P ) \\ > K) = 1 (46) 

Since the above holds for every K £ T + , we have 

lim sup P T (t, 6 R t uj, P ) II > K) = 1 (47) 



On the other hand, the stochastic boundedness of the RARE 
sequence and Lemma 14 imply 

lim sup P V (\\(f R (t, 6 R t 0J, Po)\\> K) 

K^oc teT+ 

= lim sup F v > Pa (\\P t \\ > K) 

= (48) 

This contradicts eqn. (47) and a) does not hold. Thus b) 
holds, and we have the result. ■ 
Lemma 19 establishes the existence of a unique almost 
equilibrium vP if the schedule V is weakly detectable (or 
more generally leads to stochastic boundedness of the RARE 
sequence.) From the distributional equivalence of pull-back 
and forward orbits, it follows that the transition semigroup 
generated by the RARE Markov process is uniquely ergodic, 
i.e., the Markov process has a unique invariant probability. 
However, to show that the measure induced by u v on 
E>¥ is attracting, 7 eqn. (42) must hold for all initial v. 
Lemma 19 establishes convergence for a restricted class of 
initial conditions v. We need the following result to extend 
it to general initial conditions, whose proof follows from 
properties of the Lyapunov and Riccati operators. 

Lemma 20 For a schedule V, let vP be an almost equilib- 
rium of the RDS (6 R , ip R ) . Then 

F v (to : u v (lu) h Q) = 1 (49) 

Proof: [Proof of Theorem 7] We now complete the proof 
of Theorem 7. We only highlight the key steps, the details 
follow the development in [ 1 ] . Let yP be the distribution of 
the unique almost equilibrium in Lemma 19. By Lemma 20 
we have \P (§f + ) = 1. Let P Q £ §f be an arbitrary initial 
state. Recall Cl* as the 6> fl -invariant set with P^(fT) = 1 in 
Lemma 19 on which the almost equilibrium vP is defined. 
By Lemma 20, there exists Cl x C Cl* with P p (fii) = 1, such 
that 

vP(uj) > 1 Q,uj£C1 1 (50) 
Define the random variable X : Cl i — > §^ by 
(P Q if lo£C1 1 

\ ifcj£Cli y ' 

Now choose a > sufficiently large, such that, Pq < aQ, 
which is possible because Q ^> 0. Then it can be shown 

0^X{uj)^ au~(uj), uj£CI* (52) 

Then, by Lemma 19, we have 

Hm ip R (t, 6 R t u, X (0 R t Lu)^) = v?(u), us £ Cl* (53) 

which implies convergence in distribution, i.e., 

<p r (t,e R t u,x (e R t Lo)) (54) 

as t — > oo. Then by Lemma 14, the sequence 

'Attracting here refers to convergence in distribution to the unique 
invariant measure from every initial condition. 



(t, oj, X(oj)J I also converges weakly to the 

unique stationary distribution /i 7 . 

Now, since P~(«i) = 1, by eqn. (51) 

<p R (t,u),P ) = tp R (t,u),X(u)) , P~a.s., t e T+ (55) 

from which we can conclude that 

Pt =*> ^ (56) 
as t — > oo. ■ 

B. Proof outline for Theorem 8 

The proof is lengthy and will be treated in detail elsewhere. 
The general line of arguments follow the corresponding in [ 1 ] 
for the single sensor case. It can be shown that the Markov 
process {P(t)} possesses the weak Feller property, hence 
the support of its attracting probability is the intersection of 
the topological lower limits of the forward orbits emanating 
from all initial conditions (see, for example, [16].) The result 
can then be obtained by analyzing the limit properties of 
the maps /jS. We refer the interested reader to [1], which 
although deals with the single sensor problem, reflects the 
key technical arguments necessary for the development. 
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VII. Conclusions 

We considered a broad class of estimation problems 
arising in networked control systems and established the 
ergodicity of the optimal estimation error process under 
fairly general conditions. The resulting invariant distribution 
is not absolutely continuous w.r.t. the Lebesgue measure in 
general, and we explicitly identify the support of its invariant 
distribution. We envision the applicability of the techniques 
developed in this paper to the pathwise analysis of more 
general hybrid or switched systems. 
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